Agreement Between Experts and an Untrained Crowd for Identifying Dermoscopic Features Using a Gamified App: Reader Feasibility Study

Background Dermoscopy is commonly used for the evaluation of pigmented lesions, but agreement between experts for identification of dermoscopic structures is known to be relatively poor. Expert labeling of medical data is a bottleneck in the development of machine learning (ML) tools, and crowdsourcing has been demonstrated as a cost- and time-efficient method for the annotation of medical images. Objective The aim of this study is to demonstrate that crowdsourcing can be used to label basic dermoscopic structures from images of pigmented lesions with similar reliability to a group of experts. Methods First, we obtained labels of 248 images of melanocytic lesions with 31 dermoscopic “subfeatures” labeled by 20 dermoscopy experts. These were then collapsed into 6 dermoscopic “superfeatures” based on structural similarity, due to low interrater reliability (IRR): dots, globules, lines, network structures, regression structures, and vessels. These images were then used as the gold standard for the crowd study. The commercial platform DiagnosUs was used to obtain annotations from a nonexpert crowd for the presence or absence of the 6 superfeatures in each of the 248 images. We replicated this methodology with a group of 7 dermatologists to allow direct comparison with the nonexpert crowd. The Cohen κ value was used to measure agreement across raters. Results In total, we obtained 139,731 ratings of the 6 dermoscopic superfeatures from the crowd. There was relatively lower agreement for the identification of dots and globules (the median κ values were 0.526 and 0.395, respectively), whereas network structures and vessels showed the highest agreement (the median κ values were 0.581 and 0.798, respectively). This pattern was also seen among the expert raters, who had median κ values of 0.483 and 0.517 for dots and globules, respectively, and 0.758 and 0.790 for network structures and vessels. The median κ values between nonexperts and thresholded average–expert readers were 0.709 for dots, 0.719 for globules, 0.714 for lines, 0.838 for network structures, 0.818 for regression structures, and 0.728 for vessels. Conclusions This study confirmed that IRR for different dermoscopic features varied among a group of experts; a similar pattern was observed in a nonexpert crowd. There was good or excellent agreement for each of the 6 superfeatures between the crowd and the experts, highlighting the similar reliability of the crowd for labeling dermoscopic images. This confirms the feasibility and dependability of using crowdsourcing as a scalable solution to annotate large sets of dermoscopic images, with several potential clinical and educational applications, including the development of novel, explainable ML tools

Identification of novel subgroup a variants with enhanced receptor binding and replicative capacity in primary isolates of anaemogenic strains of feline leukaemia virus

<b>BACKGROUND:</b> The development of anaemia in feline leukaemia virus (FeLV)-infected cats is associated with the emergence of a novel viral subgroup, FeLV-C. FeLV-C arises from the subgroup that is transmitted, FeLV-A, through alterations in the amino acid sequence of the receptor binding domain (RBD) of the envelope glycoprotein that result in a shift in the receptor usage and the cell tropism of the virus. The factors that influence the transition from subgroup A to subgroup C remain unclear, one possibility is that a selective pressure in the host drives the acquisition of mutations in the RBD, creating A/C intermediates with enhanced abilities to interact with the FeLV-C receptor, FLVCR. In order to understand further the emergence of FeLV-C in the infected cat, we examined primary isolates of FeLV-C for evidence of FeLV-A variants that bore mutations consistent with a gradual evolution from FeLV-A to FeLV-C.<p></p> <b>RESULTS:</b> Within each isolate of FeLV-C, we identified variants that were ostensibly subgroup A by nucleic acid sequence comparisons, but which bore mutations in the RBD. One such mutation, N91D, was present in multiple isolates and when engineered into a molecular clone of the prototypic FeLV-A (Glasgow-1), enhanced replication was noted in feline cells. Expression of the N91D Env on murine leukaemia virus (MLV) pseudotypes enhanced viral entry mediated by the FeLV-A receptor THTR1 while soluble FeLV-A Env bearing the N91D mutation bound more efficiently to mouse or guinea pig cells bearing the FeLV-A and -C receptors. Long-term in vitro culture of variants bearing the N91D substitution in the presence of anti-FeLV gp70 antibodies did not result in the emergence of FeLV-C variants, suggesting that additional selective pressures in the infected cat may drive the subsequent evolution from subgroup A to subgroup C.<p></p> <b>CONCLUSIONS:</b> Our data support a model in which variants of FeLV-A, bearing subtle differences in the RBD of Env, may be predisposed towards enhanced replication in vivo and subsequent conversion to FeLV-C. The selection pressures in vivo that drive the emergence of FeLV-C in a proportion of infected cats remain to be established

Interventions and approaches to integrating HIV and mental health services: a systematic review.

BACKGROUND: The frequency in which HIV and AIDS and mental health problems co-exist, and the complex bi-directional relationship between them, highlights the need for effective care models combining services for HIV and mental health. Here, we present a systematic review that synthesizes the literature on interventions and approaches integrating these services. METHODS: This review was part of a larger systematic review on integration of services for HIV and non-communicable diseases. Eligible studies included those that described or evaluated an intervention or approach aimed at integrating HIV and mental health care. We searched multiple databases from inception until October 2015, independently screened articles identified for inclusion, conducted data extraction, and assessed evaluative papers for risk of bias. RESULTS: Forty-five articles were eligible for this review. We identified three models of integration at the meso and micro levels: single-facility integration, multi-facility integration, and integrated care coordinated by a non-physician case manager. Single-site integration enhances multidisciplinary coordination and reduces access barriers for patients. However, the practicality and cost-effectiveness of providing a full continuum of specialized care on-site for patients with complex needs is arguable. Integration based on a collaborative network of specialized agencies may serve those with multiple co-morbidities but fragmented and poorly coordinated care can pose barriers. Integrated care coordinated by a single case manager can enable continuity of care for patients but requires appropriate training and support for case managers. Involving patients as key actors in facilitating integration within their own treatment plan is a promising approach. CONCLUSION: This review identified much diversity in integration models combining HIV and mental health services, which are shown to have potential in yielding positive patient and service delivery outcomes when implemented within appropriate contexts. Our review revealed a lack of research in low- and middle- income countries, and was limited to most studies being descriptive. Overall, studies that seek to evaluate and compare integration models in terms of long-term outcomes and cost-effectiveness are needed, particularly at the health system level and in regions with high HIV and AIDS burden

Revising the WHO verbal autopsy instrument to facilitate routine cause-of-death monitoring.

OBJECTIVE: Verbal autopsy (VA) is a systematic approach for determining causes of death (CoD) in populations without routine medical certification. It has mainly been used in research contexts and involved relatively lengthy interviews. Our objective here is to describe the process used to shorten, simplify, and standardise the VA process to make it feasible for application on a larger scale such as in routine civil registration and vital statistics (CRVS) systems. METHODS: A literature review of existing VA instruments was undertaken. The World Health Organization (WHO) then facilitated an international consultation process to review experiences with existing VA instruments, including those from WHO, the Demographic Evaluation of Populations and their Health in Developing Countries (INDEPTH) Network, InterVA, and the Population Health Metrics Research Consortium (PHMRC). In an expert meeting, consideration was given to formulating a workable VA CoD list [with mapping to the International Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10) CoD] and to the viability and utility of existing VA interview questions, with a view to undertaking systematic simplification. FINDINGS: A revised VA CoD list was compiled enabling mapping of all ICD-10 CoD onto 62 VA cause categories, chosen on the grounds of public health significance as well as potential for ascertainment from VA. A set of 221 indicators for inclusion in the revised VA instrument was developed on the basis of accumulated experience, with appropriate skip patterns for various population sub-groups. The duration of a VA interview was reduced by about 40% with this new approach. CONCLUSIONS: The revised VA instrument resulting from this consultation process is presented here as a means of making it available for widespread use and evaluation. It is envisaged that this will be used in conjunction with automated models for assigning CoD from VA data, rather than involving physicians

Why Are Regulations Changed? A Parcel Analysis of Upzoning in Los Angeles

Planners, officials, and neighborhood groups often debate zoning changes, yet there is little empirical evidence explaining why zoning and other land use regulations are changed. I use logistic regression models to examine density-enabling rezoning (“upzoning”) in Los Angeles. I find that upzoning occurs where there are development opportunities combined with limited political resistance. Upzoning is most likely on well-located parcels zoned for low-intensity, nonresidential uses. Meanwhile, homeowners—and particularly homeowners with access to valuable amenities—are associated with regulatory stasis. I conclude by recommending strategies for addressing homeowners’ concerns about higher density housing

Industry in Motion: Using Smart Phones to Explore the Spatial Network of the Garment Industry in New York City

Industrial agglomerations have long been thought to offer economic and social benefits to firms and people that are only captured by location within their specified geographies. Using the case study of New York City’s garment industry along with data acquired from cell phones and social media, this study set out to understand the discrete activities underpinning the economic dynamics of an industrial agglomeration. Over a two week period, data was collected by employing the geo-locative capabilities of Foursquare, a social media application, to record every movement of fashion workers employed at fashion design firms located both inside and outside the geographical boundaries of New York City’s Garment District. This unique method of studying worker activity exposed the day-to-day dynamics of an industrial district with a precision thus far undocumented in literature. Our work suggests that having access to the cluster provides almost the same agglomeration economies as residing within its borders.Rockefeller Foundatio

Classifying perinatal mortality using verbal autopsy: is there a role for nonphysicians?

<p>Abstract</p> <p>Background</p> <p>Because of a physician shortage in many low-income countries, the use of nonphysicians to classify perinatal mortality (stillbirth and early neonatal death) using verbal autopsy could be useful.</p> <p>Objective</p> <p>To determine the extent to which underlying perinatal causes of deaths assigned by nonphysicians in Guatemala, Pakistan, Zambia, and the Democratic Republic of the Congo using a verbal autopsy method are concordant with underlying perinatal cause of death assigned by physician panels.</p> <p>Methods</p> <p>Using a train-the-trainer model, 13 physicians and 40 nonphysicians were trained to determine cause of death using a standardized verbal autopsy training program. Subsequently, panels of two physicians and individual nonphysicians from this trained cohort independently reviewed verbal autopsy data from a sample of 118 early neonatal deaths and 134 stillbirths. With the cause of death assigned by the physician panel as the reference standard, sensitivity, specificity, positive and negative predictive values, and cause-specific mortality fractions were calculated to assess nonphysicians' coding responses. Robustness criteria to assess how well nonphysicians performed were used.</p> <p>Results</p> <p>Causes of early neonatal death and stillbirth assigned by nonphysicians were concordant with physician-assigned causes 47% and 57% of the time, respectively. Tetanus filled robustness criteria for early neonatal death, and cord prolapse filled robustness criteria for stillbirth.</p> <p>Conclusions</p> <p>There are significant differences in underlying cause of death as determined by physicians and nonphysicians even when they receive similar training in cause of death determination. Currently, it does not appear that nonphysicians can be used reliably to assign underlying cause of perinatal death using verbal autopsy.</p

Systematic, comprehensive, evidence-based approach to identify neuroprotective interventions for motor neuron disease: using systematic reviews to inform expert consensus

Objectives: Motor neuron disease (MND) is an incurable progressive neurodegenerative disease with limited treatment options. There is a pressing need for innovation in identifying therapies to take to clinical trial. Here, we detail a systematic and structured evidence-based approach to inform consensus decision making to select the first two drugs for evaluation in Motor Neuron Disease-Systematic Multi-arm Adaptive Randomised Trial (MND-SMART: NCT04302870), an adaptive platform trial. We aim to identify and prioritise candidate drugs which have the best available evidence for efficacy, acceptable safety profiles and are feasible for evaluation within the trial protocol. Methods: We conducted a two-stage systematic review to identify potential neuroprotective interventions. First, we reviewed clinical studies in MND, Alzheimer’s disease, Huntington’s disease, Parkinson’s disease and multiple sclerosis, identifying drugs described in at least one MND publication or publications in two or more other diseases. We scored and ranked drugs using a metric evaluating safety, efficacy, study size and study quality. In stage two, we reviewed efficacy of drugs in MND animal models, multicellular eukaryotic models and human induced pluripotent stem cell (iPSC) studies. An expert panel reviewed candidate drugs over two shortlisting rounds and a final selection round, considering the systematic review findings, late breaking evidence, mechanistic plausibility, safety, tolerability and feasibility of evaluation in MND-SMART. Results: From the clinical review, we identified 595 interventions. 66 drugs met our drug/disease logic. Of these, 22 drugs with supportive clinical and preclinical evidence were shortlisted at round 1. Seven drugs proceeded to round 2. The panel reached a consensus to evaluate memantine and trazodone as the first two arms of MND-SMART. Discussion: For future drug selection, we will incorporate automation tools, text-mining and machine learning techniques to the systematic reviews and consider data generated from other domains, including high-throughput phenotypic screening of human iPSCs

An Indo-Pacifc coral spawning database

The discovery of multi-species synchronous spawning of scleractinian corals on the Great Barrier Reef in the 1980s stimulated an extraordinary effort to document spawning times in other parts of the globe. Unfortunately, most of these data remain unpublished which limits our understanding of regional and global reproductive patterns. The Coral Spawning Database (CSD) collates much of these disparate data into a single place. The CSD includes 6178 observations (3085 of which were unpublished) of the time or day of spawning for over 300 scleractinian species in 61 genera from 101 sites in the Indo-Pacific. The goal of the CSD is to provide open access to coral spawning data to accelerate our understanding of coral reproductive biology and to provide a baseline against which to evaluate any future changes in reproductive phenology